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the Bna-aealt and coareo-realc repraenlationa may b» qualitatively different. For 
mtampfe, Figure t ihow. an imagt of an oak l«f, Ih» region boondarin in Ihc 
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1 have implemented an algorithm for computing Local Rotational Symmetry 
representations. Figure 5 shows the regions that found by the program for the 
images in Figure 1. The program Identifies the bowl of the teaspoon, the body and 

and the squash, as well as a few round regions of spectral reflection on the spoon, 
end of the gourd, all of which are also more round than elongated. These round 




In the course of developing this representation for round regions. I have had 



b, analyses at different scales of resolution ore explicitly related. Information 


rithm for computing symmetries to be strictly local. Further, the explicit relation- 
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Analogous to the Kale-spate analysis of inflections in a one-dimensional signal pro¬ 
posed by Witkin (1083), These ideas could also be applied to a re-implementation 
of Smoothed Local Symmetries. 






stional Symmetry- In addition to the 
























cm be well-represented with one 2-dirnensional black and white picture, e.g. flat 
objects such as leaves or spMner wrenches. For some of the examples shown, 


jeet. For example, it is difficult or impossible to identify vegetables and fruits out 














► Evidence from sources such ns linguistic datn often reflects factors other than 
2-dimensional shape. Detailed formal analysis of such data will be difficult to 
do until we have developed a fuller theory that includes preliminary represen¬ 
tations of 3-dimensional shape, color, function, and so forth. 


analysing linguistic data except with reference to a preliminary theory which 
is precise and already an approximate match to the facts Existing methods 
for quantifying properties of shapes {see Zusne 1970, chapter 5) are crude and 

* Experiments that use more general or more perceptually plausible properties 
but without precisely defining them are difficult to interpret. For example, 
the work presented in Biederman {unpub!.) is difficult to relate to issues of 


3.1. Invariance under simple transformations 


The sixe of an object and its orientation and location in the visual field should 

changes in sixe, orientation, and location. Secondly, although relative size, orien¬ 
tation, and location of objects within a scene or sub-objects within an object can 
be important in classification of the sci 


location of an object in space or in the visual field is generally not important. 

pendent of changes in these parameters. All of these facts suggest that regions are 

















However, such imperfections also occur in line drawings of objects produced by 

in these drawings. Thus, whether or not the edge finder could be improved, 
shape representation algorithms must not be sensitive to such types of small 

ge disruptions in the overall representation. 

nnecessary. There are a variety of types of detail that need to be abstracted 


s. Good examples of this 

occur in practical reasoning. R 
is often done by reasoning about an abstracted representation of the object. For 
example, a detailed representation of a hummock is that it is a regular mesh of 
cords. An abstracted representation of a hammock might be that it is a thin 
sheet. Using the flat sheet representation, people con reason about the behavior 






2.4. Speed of r 


how much detail to lo be represented for each pari of the scene, depending on 
the goab of Ihe observer. Compulation of representations of common objects 
in sufficient detail to recognise them, including choice of appropriate amounts 
















is that Ihcrp should not bo 







t. This does not se 









and axes lie. Thi* implies that these features of shapes are psychologically real. 
People refer to a region and its boundary, explicitly recognising both and relating 
them to each other. Thus, a model of how humans represent shape should make 
these notions explicit and its use of them should agree with human judgements. 


People describe complex shapes in terms of subparts which are adjoined or 
cut out of each other. This implies that the representations should build complex 


relatively stable under attachment of other objects to the object being described. 
For example, the handles of a knife, fork, and spoon from the same silverware 




J.7. Stability under change of 3-D view 


data, directly reflect 3-dimensional situations, However, tk 


variable 2-dimensional Images, depending on the 
> is viewed. Changes to an image which depend on 






In this thesis, I will avoid the difficult question! concerning the relationships 
19W) of visual scenes and 3*d!mensional models of objects and scenes by only 


3: Local Symmetry Re 
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Chapter 




required. 










It b possible that other teatures of a grey-scale image besides boundary lo¬ 
cations might be used in shape description. The edge finder I use (Canny 1983) 















The Smoothed Local Symmetry (SLS) representation for elongated shapes 
(Brady 1983, Brady and Asada 1984, Hcide 1984. Connell 1985) is based on 




the angle between AB and the outward normal at B. The symmetry renter (C) 
for such a pair of points is the midpoint of AB. Another way to describe this 

















pain of symmetry points arc called the riba of the region and the length of a rib 
measures the local width of the region. The two-dimensional region covered by the 
symmetry region is the union of all of the ribs or, alternatively, the region bounded 
by the two sides and the first and last ribs. Figure 2 shows the boundaries, region 
covered, axis, and selected ribs for one symmetry region. The symmetries in a 
Smoothed Local Symmetry region must progress in a consistent direction along 
the axis. That is, the region cannot double back on itself, as illustrated in Figure 2. 

ry region computed from a digitised input 
id the width of the region for 
each of the discrete set of symmetry pairs that make up the symmetry region. 

describe various salient features of the region, including: 




whether the region is part of the object being considered or part of the back¬ 
ground (determined by the color of the the region in current implementations). 


For more detailed description of descriptive parameters for SLS regions, see Con¬ 
nell (1985) and Heide (1984). The aspect ratio of a region can be used as a 

peet ratio is typically not salient, whereas a region with a low aspect ratio is, as 
shown in Figure 4 (Also see discussion in section 6.3 “Locality of Computation'.) 

In analysing a shape into symmetry regions, there are a number of features 
that indicate where there are boundaries between regions or subregions: 


• an interior color boundary; 

s a sharp change in one of the parameters of the region, eg a sharp bend in 
the boundary or the axis, a sharp change In the width of the region, a sharp 

• a minimum of width. (This criterion has been proposed but is not used in 
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round, nor for half-open regions bounded by one straight side, such as background 





































fleeted corves that locally 


of boundary. More precisely, 1 will say 
no/ Symmetry fLRS) to a center loca- 


y points guarantees that if you map a 
by section of boundary, each boundary 
proxlmately tangei 
approximately a i 
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may be broken up into disconnected sections by attached or occluding parts, or 
by sections cut out of the region. For example, Figure 20 shows the boundary 
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ing the grey-scale image and sampling it at a rale proportional to the amount of 
smoothing done. (Chapter 6.1 compares this type of smoothing to other methods 



than the mask sire. Images whose dimensions are unequal are padded to make 
























reprinted by it. .-and y-di.placemenl from the center. Displacement value. .re 
vda« »re trivial to compute from the center location and the origin^ edge map. 














180 degrees apart. (There may be aimilarly efficient ways for determining relative 
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' teal boundary points found 


by the edge finder. 


The current evaluation function combines this factor addilively with the an¬ 
gular length and deviation term. For a clewed boundary, the evaluation is: 

• * £ (100 is the value of A, the percentage of the angular length of a full 

circle for any closed boundary!). 


For an open boundary, the evaluation is: 

• 

The constant determining the bnlance between the evaluation term and the 
fidelity term was determined by experimentation. In order for a region to be con¬ 
sidered minimally acceptable, its evaluation must be over a threshold, currently 
7.0. Running the program on examples suggested that this was the approximate 
location of the cut-off between regions that seemed perceptually plausible and 
regions that didn't. Regions near this cut-off seemed marginal. It must also meet 
minimal requirements on angular length and deviation. Currently, the minimum 
angular length is 10 percent of a circle and the maximum average deviation is 20 

In fan there are two ways in which a boundary point can be hypothetical, 
i a real boundary point of the original image. First, the original image 
uiignt not have had a point at that location at all. Secondly, there might have 
been a point there, but not with the orientation assumed in the boundary. In 
other words, in the second case, the algorithm Is assuming a boundary point 
where there was one in the image, but correcting the orientation to something it 

In rases where the program corrects the orientation of a boundary point or 
In which it hypothesises a new boundary point at a location very close to a real 
boundary point, it h. not obvious how to interpret -fidelity to the input data'. 

be to say that such points are worse 





point unaltered. 



















boundaries using hypothesised points, rather than following the input boundaries. 
Also, in looking at the program's analyses of oval or ellipse-type shapes, it seems 


as if the relative balance between angular length and av 
exactly right. The program analyzes some shapes as . 






study of human perceptions of these shapes would be necessary to make the 
program's evaluations exactly match human judgements. 




id finding locally optimi 










olds on the angular deviation. (The cur- 
















percentage of real boundary point* in the region, which i* a global maaaure of fi¬ 
delity; and the length of the join between two Mellons of boundary relative to the 










































3=3 


3 = 

3 = 


=3 

=3 

=3 


3=3 

3 

3=3 


» : 


A. 


























with two ends, the program finds the correct analysis robustly. For intermediate 
figures, the program finds one or both of the analyses, but in a somewhat degraded 

















of edges which look locally like parts of ct 



res. In figun 





i figure. Fin 
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times the length of the smaller pieee of boundary. From these examples, it seems 
that this threshold is too permissive, Secondly, although the program finds the 
right-hand head of the wrench at coarser scales, it gets confused by the shadow 
line that appears along the bottom of the wrench at finer scales. It fust builds 
a spiral boundary for the right-hand head with a misplaced center location, and 
then (because the center passed down as a suggestion is bad), loses the region 

algorithm to merge two boundaries which are very close together, when this would 
lead to a better analysis of the region. 

In sum, the regions chosen by the program to describe input images are rel- 

elutter in the images do not prevent the program from finding these regions. 
There arc also a variety of errors, most of which can be explained as reflecting 






is linear in the size of the input. For 
similar reasons, smoothing the image and finding edges to make the input to the 
LRS algorithm also takes time linear in the size of the input. 

as a worst-case estimate. In fact, the computation time spent per center is a func- 

the real expected running lime of the exhaustive compulation is also function of 
the -complexity' of the image at each scale. It would be nice if this measure of 
■complexity’ correlated with psychological data, but I have no evidence either 


rse scales takes additional 


Making finer-scalc versions of regions found at co 

time which » a function of the number of good n 0 ..__.„ ... _ .... 

The time spent computing refinements of a region gets larger as one move to 
increasingly fine scales, because the number of points in the boundary gets larger. 
In fact, computing extremely fine refinements of a region that is stable over a 
large range of scales can take large amounts of computation. Therefore, it may¬ 
be necessary to impose some limit on the maximum radius at which deuilled 

The current implementation is slow on a Symbolics 3600. Analysis of a 
medium-size example shown in this section to the finest scale of resolution takes 
all night. However, roost of the algorithm is highly parallel and would be speeded 
up drastically by parallel hardware or hardware assists. Since the computation 

available hardware. Furthermore, it is likely that belter theories of how to create 

Since the compulation time is roughly linear in the area of the input, any such 
speed up m the time per center will result in a corresponding speed up in the 


Chapter 5: Is 





Loral symmetry representations include Smoothed Local Symmetries, Local 
Rotational Symmetries, and the Symmetric Axis Transform (Blum 1973, Blum 


. Shape models are local; 



















given shape can have Generalised Cylinder representations based on more than 

pul shape. In contrast, the local symmetry constructions explicitly define an axis 
or center for a shape constructively in terms or the inpot shape. This means that 
local symmetry' representations do not need an auxiliary algorithm for choosing 

well to the perceived axes of shapes. 

shape models can be summarised by saying that local symmetry representations 
lend themselves to shape description techniques which arc more bottom-up and 
constructive than the model-fitting approaches. The shape models used arc very 

against itself with some translation, rotation, or possibly reflection. Such global 
matching symmetries within an image mny also be useful in describing an image. 
However, they represent different types of properties from the region-forming local 
as described in this thesis. 




Moot shapes of common objects are too complex to be represented by a single 
local symmetry region. A local symmetry description of a pear, an airplane, a 
wrench, a square, or a triangle Involves several local symmetry regions 
oined together dr cut out from one another. In order to be useful for recognising 
oning about shapes, the raw local symmetry analysis must be transformed 


















Kion (cf. Brady and Asada 




















when they cover overlapping 2-dimensio 
the other, as Figure 3 illustrated. 








This statement of the constraint, however, does not seem to be quite correct 
The problem is that some types of regions seem to be able to ««,iM even though 
they share boundary and cover overlapping regions. For example, the corners of 
a rectangle earn to be salient, despite being In conflict with the main axis of the 

a spanner wrench wen, to coexist with the region, describing the round 
square cut-out. of the wrench, „ oval that is on the borderline between round 
and elongated can be dewnbed as one round region or a. having two round ends. 
It rs not clear that mam region of such an ellipse and its more coherent round 
ends are peceptually in conflict. These examples are shown in Figure 7 

My LRS implementation uses tho heuristic that two regions overlap incom¬ 
patibly if they share half of their contour. As some of the output exa 1 - 
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Man and Nishil.ua (1978) 














gions are analysed as one irregular round region. Intermediate shapes have both 
analyses, with varying degrees of relative salience, Similarly, Figure 9 shows the 


using only one shape model, e.g. Smoothed Local Symmetry regions, but match' 
ing it to the shape in different ways. Figure 10 shows gradual transitions from a 
















to refer to objects- The data presented in Labov (1973) suggest that there is a 
smooth decay in how well a shape is perceived as member of the class named 


Fifurs 813. A shape that dossn' 



The Smoothed bocal Symmetry code described in Brady (1933), Brady and 
Asada (1984), and lieide (1984) Incorporates a constraint which I will call the 
Region Color Constraint. The idea behind this constraint b that a local symmetry 
between two sections of boundary is only salient if the color of the region on the 
interior sides of the boundaries (i.e. the sides toward the symmetry axis) is similar. 
For example, the symmetries shown in Figure 1< 

in Figure IS. Figure 16 illustrates the fact that 
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Chapter 6: Multi-scale representations 


The shape representations discussed in Chapters 3 and 5 all represent shapes 
with a Used. Bail, amount „f detail or resolution. Fo, recognising and reason!^ 
about objects and scenes, we need to be able to represent a shape with any 
arbitrary amount of resolution, in order to be able to distinguish small differences 

detail when it is not needed, repenting only the most important 

■t m ' 1 b r having a series of 

...amounts of detail. If the represenutions 

at different level, related, so that information computed a. one level can be 
transfered to other levels, a multi-scale representati 
apparently incompatible goals at the san 

Results are highly accurate and representations are highly detailed; 

• Computations and representation, are stable under small changes in inpu 
lependencies that are non-local in the original ini 


’ ::::rr n ' hi>e oni! io ' , ‘ i da, “ d ' p, ' nd ' n,:i ' ! ' *■ m c. 

ttue used for computation and thus are efficient, particularly on parallel hard¬ 
line. of them goals, by a wide variety of researchers Pyramid-sh^'p^^ 
. ructure. have been widely us* i„ image pmcessing. For a 
literature, « Tan i mom (IB7fi). The main goal in this j. 10 ^ pyrmid . 
•hap, -ray. of procemin, elemenu to do efficient calculation. On the vision end 

rithtnsT' (l9,,) mUhi -* rid - P~<-«vffic-n. algo- 

rithm. fo, surface construction. Again, although he is inmnaud |„ producing 
output at multiple wale, of resolution, much of the focua is on using ,h, py r „n id 
structure to allow efficient computation. 

in I 1 "" ^ ““ ■ b 7 '° n ‘ id "* bk W ° rk d “"' « Bndi "« “■< interpreting edge. 
Images at mult,pie scales, surveyed by Torre and Poggio (IMt). Them re- 
searchers find representing edges at multiple scales interesting because the t f 
edges in an irrmge a. all scale, may be a complete repmsenu.ion of the ,maraud 

also because multiple-scale representation. .It™ _j,. .. . “ 



coarse scales) and good localisation of edges (at Bne scales). For example, the 
edge Bnder described in Canny (1983) finds edges in an image at multiple scales 


to yield a unified map of edges at all scales, 
using an explicit mathematical theory of how an edge at one scale will be rollecled 
at the next coarser scale. Witkin (1983) proposed summarizing multiple-scale rep¬ 
resentations of a signal into what he calls a -scale-spate" representation. In this 
representation, the shape of the signal across Kales is summarised qualitatively 
by describing: the set of features in the signal, the range of Kales at which each 
feature occurs, and the Kales at which features split or merge. In his work, the 
features considered are inflection points of a one-dimensional signal. 


There has been less work done on multlple-Kale representations using features 
that are higher-level than edges. Asada and Brady (1984) developed a system for 
locating sharp changes in orientation along boundaries (corners, for example) 


_ „_n's representation for one-dimensional signals. Ponce and Brady (1985) 

extend this work to representing the shape of 3-dimensional surfaces. Hoffman 
(1983) tried to locate "natural Kales" in multi-Kale representations of boundary 
curves. Crowley (1962) locates and tracks features for describing regions across 
Kales but he uses relatively ad hoc methods for relating representations at dlf- 


On the other side of the fence, researchers working on planning and reasoning 
have been talking about representing situations or objects at multiple levels of 
resolution or abstraction, although there are only a few systems that actually »» 
this idea Planning can be made more efficient if it is done first w ith a coarae-Kale 
representation of the problem and then fleshed out in more detail, most recently 
proposed by Allen and Kooroen (1983). They also propose using a hierarchical 
organisation of lime intervals In order to restrict explicitly stored temporal re¬ 
lations to intervals local to one another. Such a locality restriction would allow 
algorithms for reasoning about temporal relationships to run efficiently. There has 
been some limited work in using representations which involve fushfoftee changes 
in representation between finer and coarser scales, foe example Weld (1984) and 
Patil (1981). Taylor (1977) and Dowty (1979:163-173) have dtaussed problems in 
the that have been diKussed in natural language semantics that could be resolved 


Shape representation lies somewhere in between the low-level visual processing 




and high-level representations for reasoning and natural language understanding. 

these two type* of processing. Very little work has been done on creating shape 
representations at multiple levels of resolution. Mart and KMiIhara (1978) pro¬ 
pose using multi-scale representations for objects, but their proposal is not very 
detained. Brady and Asada (1984) build Smoothed Local Symmetry Represen¬ 
tations for shapes at multiple scales of resolution, but they do not relate the 
representations at adjacent scales. In building an efficient implementation for 
computing Local Rotational Symmetries. I have had to reconsider the way in 
which Brady and Asada computed multiple scale representations. The goal in de¬ 
signing the multi-scale LRS representation haa been not only to use multiple-scale 
representations for efficiency and compatibility with theories or low-level vision. 

standing systems that might be using its output. My implementation of Local 
Rotational Symmetries uses a local multi-scale computation with communication 
between scales. Detection of cross-scale features and patterns has not yet been 
implemented, although the inter-scale matching provides support for adding such 


and cross-scale features; 



jr “overall" features of Bncr-scale representations, abstracting 
away from detail. In practical reasoning, the importance of some feature is de¬ 
termined by a large number of factors, including functional importance as well as 
sire. For example, the difference in the shape of the business ends of a Philips and 



a regular (slotted) screwdriver is crucial in explaining the functional properties 

a feature is represented may or may not be a constant across the entire repre- 
a chair, the chair 


In the early analysis of a visual image, the only index of importance available 

as an index of importance. However, nothing prohibits later reasoning from re¬ 
adjusting the results of these early analyses or influencing processing of shape as 

focus on in a complex scene (e.g. a large cluttered room) are clearly dependent 
on the viewer's goals. How far down the influence of higher-level goafs extends 
in visual processing is an empirical qt 

on higher-level information, but could make use of such information to guide 
processing, were it available. Similarly, these algorithms do not crucially depend 

ten involve qualitative differences in representation compared to finer-scale views 
of the same object. For example, the fact that brushes can clean particles oil of 
surfaces depends on the outside of a brush being made up of a large number of 
bristles. Thus, a fine-scale view of bristle texture can be used to explain why a 
door brush is different from a blackboard eraser. However, understanding what 
shapes of brushes an 
sidering an abstracted re 

of the businem ends of bristles, the attachment ends of bristles, or the sides of 
bristles. For example, a bottle brush can be represented as a cylindrical bristle 


- -j a flat back. In fact, the coarse-scale 

representation of a Boor brush is very similar to the coarse-sc ale representation 
of a blackboard eraser, a fact which makes it easy to explain why these brushes 

whereas a bottle brush requires rather different hand motions and is used on dif¬ 
ferent type* of surfaces Reasoning about the functions of these brushes directly 
from individual bristle locations without using abstracted bristle surfaces would 
be extremely slow and tedious. 

with a serrated edge shown in Figure I. Standard terminology for describing leaf 
shapes (cf. Petrides 1072) separates the description of a leaf into a description of 
its overall shape (oblong, narrow, heart-shaped, long-pointed) and a description 
of the texture of its edges (wavy, toothed, double-toothed). A multi-scale local 
symmetry analysis describes both the coarse-scale shape and the fine-scale edge 
texture, as shown in the oak leaf example (Figure 1-4) and the cog example (Figure 
1-6) from Chapter I. If analysis is done at only one scale of representation, it is 
not possible, in general, to pick out both the serrations and the overall axis of the 
leaf. If the serrations are visible and don't exactly line op on the two sides, the 
overall symmetry axis will be disrupted. 



or other features in the coarse-scale representation that . 
fine-scale representation. Such qualitative changes are useful. 


sentins shape, bn also in more abstract domains. For example, recent work by 
Weld (1984) and Palil (1981) uses qualitatively different representations to res¬ 
ides' could also solve the problems in representing non-hornogencous actions dis¬ 
cussed by Taylor (1977) and Dowly (1979). The specific examples that Taylor and 
Dowry discuss are in linguistic semantics, but the axioms used by Allen (1984) 
for representing actions (or practical reasoning have the same problems 

There are several techniques lor abstracting away from small detail in a visual 


a Feature dropping; 
o Boundary smoothing; 


s Threshold changing. 


Feature dropping techniques lake a symbolic representation of an image and 
remove regions or other features which are small or unimportant according to 
some criterion. This abstraction technique is extremely important in higher-level 
learning and reasoning. However, by itself, feature dropping cannot account for 




Threshold changing involves changing the setting of a threshold that is used 
to select which features are "good enough" or "salient". For example, region 
boundaries in images differ in their strengths. i.e. in how much the intensity 
changes from one side of the boundary to the other. Relaxing strength thresholds 
on boundaries results in more detailed analysis of the regions in an image. Blake 
(1983a. 1983b) uses such a threshold changing technique to produce a series of 
representations of the boundaries of an image. Like feature dropping, threshold 
changing is a useful technique for varying the amount of detail in a rcpreaentatlon. 
However, it cannot be the primary means of changing the scale of a representa¬ 
tion. First, like feature dropping, it can only remove features as one tightens the 
threshold, not add them. Furthermore, while the sharpness of a boundary is one 
Indicator of its importance within a representation at a particular scale, the siae of 
regions, rather than their sharpness, seems to determine the differences between 
representations at different scales. Finally, representations based on threshold 
changing are sensitive to blurring an image or introducing noise. 




used in Witkin (1983), there is < 




• Smooth the image and extract boundaries at each scale (used by Crowley 19 
and Canny 1983). 

• Extract boundaries from the image and smooth these boundaries (used 
Asada and Brady 198a. Brady and Aaada 1984. and Hoffman 1983). 

The advantage to extracting boundaries 

line drawings to be analysed in exactly the sa 




example, consider the image of a drain strainer shown in Figure 2, with the 
boundaries extracted by the edge finder. The internal boundaries of the holes in 

smoothing the boundaries in this image will not eliminate the internal boundaries. 
Smoothing the grey-scale image, however, extracts just the overall shape of the 

produces effects which seem to correspond well to intuitive judgements of the 
overall shape of objects. 







separating two contrast ing 
iuced artificially, and figure 


sixe and pi 


le representations are created. Whether thin regions are 
representations may depend on factors other than their 


A second problem with smoothing the grey.scale image is that when two 
objects are near one another, the smoothing will blur one into the other. In 
some coses this is desirable, for example when one is trying to describe largrr-srale 

o/ler taio Spares hole hern identified, it should be possible to re-do the smoothing 


Gaussian smoothing (with a Bnitc filter) has only local data dependencies, this 
would not require extensive re-computation. As in the case of extremely thin 
regions, it seems as though whether two objects should be separated or blurred 
into one another depends on details of the emerging shape analysis and perhaps 
on the goals of the reasoner using and directing the shape analysis. 


fl-2. Relating scales 


It is not sufficient to analyse an image independently at a series of scales. First, 
when an object has an overall shape and more detailed features, people seem to 
be able to relate their locations. For example, the axes of the lobes of the oak leaf 
discussed in Chapter I (Figure 1-4) are related in location and orientation to the 
main axis of the leaf. Secondly, efficient computation of detailed representations 
for large regions or other features requires passing information between coarser 
and finer scale. Thirdly, if representations at different scales are not related, the 


were chosen, as noted by Within (1983). F 
stable representations of parts of an image and how they ar 
more informative than a simple listing of representations at < 


noted by Witkin). 






or disappear*. The length' 


i a Riven feature is detected 


(1982) and Hoffman (1983) try to do. The theory of ab 


Theorie of smooth change in foal urns are generally more or less straight¬ 
forward. For simple fealnres, an exact mathematical analysis of posable changes 
can be done. For example. Canny (1993) does a mathematical calculation of 
the predicted shape of a fine-scale edge at a coarser-scale in order to determine 
whether it should be matched with a given coarse-scale edge. The current I.RS 
t a theory of Bmooth correspondence between LRS regions to 
rm one scale of analysis to the next finer scale. Since this 
implementation only uses the locations of boundaries and not their strength, and 
since n works from coarser scales to finer scales. Canny's results for boundsry 
matching could not be used directly. In order to pass information from one scale 
to another. I use empirically determined estimates of how much displacement to 
expect between a boundary or a center location at one wale and a corresponding 
boundary or center location at the next finer scale. The correspondences used 

one scale with regions found at the next finer scale, in order to produce a type 
of scale-space analysis of the LRS regions. This has not yet been implemented, 
although its feasibility is obvious from the smooth changes in analysis between 
different scales of the LRS analysis of lest images (see Section 1.7) and from the 


Abrupt changes include features disappearing at coarser or finer scales (Witkin 
(1983) explicitly rules out disappearances), two fine-scale features merging at a 
coarse scale, and other types of changes. (In general, two coarse-scale features 

phenomena are easiest to build for low-level features, such as the inflections that 
Witkin tracks, The set of primitives that Asada and Brady (1984) and Ponce 
and Brady (1989) use for describing boundaries Is richer than Wilkin's primitives. 
Therefore, in their representations, the possible relationships between a coarse- 
stale primitive and one or more finer-stale primitives are more complex. For 
higher-level features, such a. LRS regions, the possible type, of abrupt change, 
lintegrates at a 


between scales 


periodic variation m its radius will break apart into a series or small round regions. 
However, it is not clear to me whether there is any reason to work out all possible 





pression techniques such as the technique of approximating the contour by a set 
a substantial linear speedup in the computation for a fixed scale of resolution 
imagegrows. Not only doe. compulation time grow as O(n') in the number of 


The solution is to impute Wily „/ compu/olton: restrict exhaustive romputa. 
lion of Local Rotational Symmetries to boundaries and LRS center locations that 
are within some fixed distance of each other. Similarly, compulation of Smoothed 
Local Symmetries should be restricted to pain of boundary points local to one 
another. Not only is locality necessary for efficient computation of symmetry 
regions, but the symmetries eliminated by locality seem not to be perceptually 
salient. Since the symmetry computation runs at multiple scales of resolution, 
such a restriction does not prevent the algorithm from finding regions of arbi¬ 
trarily large site: the boundaries of large regions will be local to one another 
at a sufficiently coarse scale. Furthermore, once a symmetry region has been 
hy pothesise d at a corn* scale, it can be efficiently tracked down to finer sctdes 
.in. Thus, a local multi-scale computation in which information is 


• it is able to detect large features, 

^ The r "'™' ion ™‘ ,0 " d *>y i« that, in order to be salient, a region must 

are local. That is. if the region is elongated, it must show up at a scale at which 
ts width IS small. If the region is round, it must show up at a scale at which Its 
M > experience will, symmetry rep,event, lions of object, indicate, 

the locality restriction are no. pcrccp,'u.lly P jheM.' 

a fine scale of 
m perceptually salient: they 

:es of elongated or pointed regions in the figure. However, syi 












I. Inter-scale communication and attention 




at the center predicted by their curvature, beyond the usual search radius. Since 










' "O' perceptually salient; 

Representation' at different scales should be related and summarised in a type 
of analysis similar to Witkln'a a-- 1 - .... 


The* ideas, with the eaeeption of a full scale-space typ. anal,,,,. weremedin the 
cum-nt implementation of the algorithm for computing Local Rotational Symme- 
try regions. Similar technique, should be aim be used in computing Smoothed 
Local Symmetries. However, the only change that was easy to moke, without 


ve re-implementation, w 


se image smoothing in place of boundary 












from my LRS implementation: 


• Smoothing the grr>-w 



Perhaps allowing inexact symmetries, particularly when searching at a fine 


In fact, the Smoothed Local Symmetry code used to produce examples for this 
thesis has already been altered so that it produces representations at multiple 


artes. This allows the code to run robustly o 
images, without requiring that the bounding contour of a 
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Appendix: The Code 


The following pages list the ZETALISP code for computing Local Rotational 
Symmetry regions. Only the code for computing the symmetries and building 

ing and sampling images, code for displaying results and partial results, code for 
saving results in files and and reading them hack in. and the code for the edge 
finder described in Canny (1983). 
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